+ 



Display 



121 



Keyboard 



122 




Hard Copy 
Device 124 N- 



Sound 
Sampling 
Device 125 



Main 


Static 


Mass Storage 


Memory 104 


Memory 106 


Device jOZ 




Digital Signal 




Processor 


Processor 108 




102 



100 



FIG. 1 



+ 



p 




o 
o 

CM 



9> 



CO 



CM 



CM 
CM 



IM JC 
g <D 



CJ) — 
CO CD 

O 



CM 
CM 
CM 



■p 



CM 
CM 



CO 
CM 



cj) o o E" 

CO CD 

—I o — 









ing 


E 


CM 


2 


-SB 




0) 






O 


CO 





Mr 
<- 



on 




cati 


ram 


d. 








< 


CL 



CO 
CM 




+ 



<u SS 

CD 



CD 

o> — 


ion 


CO CD 






cu^ o 


o 




c 








CD 



CO 

o 

CO 



CD , 
CO 

CO I— 

en 

i 



o 

CO 



CO 

d 



CM 



eg 
o 

CO 



o 

CO 



t 



CD 

E 



CD 



o 

CO 
CD 

c 
CD 



c 

8 

CD 

o 

(D 
CD 
O. 
CO 



o 

I 

UJ 



CO 
CD 



-f 




FIG. 5 



+ 




FIG. 7 



+ 



o 
o 

CO 



2 

u 

D. 



■o 

UJ 



i 



0) 



mill 



□ 



> 

CD 

CM 
CO 



c 

CO 
CO 



o 
oo 

A 



0) 




!ll!l||;i|! 


icens 




( 


_i 


) 


o 

GO 




to 

O 
OO 


CNJ 

o 

oo 


Letter 


CO 

o 

oo 

i 




ence 


!lllli||l|! 



o 
E 

2 



a: 



E 

< 

8 

3 
O 



(D 

■o 





o 








E 




S 



CO 

CO 



Q. 

< 
Q. 

0) 




CD 
OO 

d 



+ 



O 
CsJ 
CO 




=1 





rrash 1 




1- 









B 
a 



E 

3 

u 

o 



CNJ 
CO 



ru 
E 




III 



11 



(D 
C 

o 



0) 
0) 



(CI (CI 
I.J u'l U'l Q 



illlilj l|! 



o 
E 

(D 

IS 



III!: Ill i|! 



c 

0) 

E 

.</> 

P 



(U 

(LI 
I.. 

hmt 

I.. 



i:.. 



::i 



» (L) 

.1 {[J .M 

:: (I) r 



CO 



(0 (CI 

c 'c:i 



9€ 



OO 

CD 



+ 




+ 



+ 



r 



0) 

> 
Q 



CO 

I 



o 
o 



CO 

■ ■■■ 

u 

Q. 



3 



-a 

LU 



0) 



■o 

CO 



00 



C 



CO 

in 



E 

0) 
CD 



□ 



□ 



o 
ay 

\ 



iiiiiil i|: 



T 



W 

c 

0) 

o 



ill''' 



o 
oo 



CM 
O 
OO 



0) 
0) 

—I 

0) 

o 
c 



T 

o 

CO 



CO 

o 

oo 



o 
E 

0) 



1 



c 
E 

0) 
0) 

O) 

< 
8 

3 

2 

0. . 




a* 



<D 


"D 




O 




UL 




E 







CO 



0) 
Q. 
Q. 
< 
CL 

i 

0) 

o 




3 
O 
0) 

c 

8 

CO 



CO 



+ 



+ 



i 



o 





"rash 1 









a 

•a 



c 
u 

E 

u 
O 

o 



c 
o 



E 



IZ; 



a 



"2 



o 
in 



□ 



o 

CD 



CD 



0 







c 








Q. 




O 









u 
C 

U 



3) 

C 
O 

■o 

fiC 

□ 



o 



i 




E 

3 
u 
O 
O 

CD 

u 
0) 

(U 



c 

cu 

E 

3 
u 
O 
Q 



E 



0) 
u 
c 



CD 

O O 3 _ 

E E "o « 

« « S q5 
Z A a. cc 



lillillMi: 



o 
E 



CD 




FIG. 10 



+ 



(For "Word" Application) 



LM6 

(Dynamic) 



1100 



license" f 1101 




"Memo" 



L 



1102 



"Producer's Agreement" T 



"Reference Letter" 




1110 



FIG. 11 



(For "Word" Application) 



LM6 

(Dynamic) 



1200 



"License" r1201 




1210 



FIG. 12 



+ 



1310 



Rule:date2 ,i301a 
Context: date 

Phrase: from <date> to <date> 



1301 



Rule:mtg1 1302a 
Context: MeetingMinder 
Phrase: "new meeting" 



y 



1302 



1303 



1303a 



Rule: btnl 
Context: — - 
Phrase: <buttonName> 



1320 

Rule Set 
Partition 



Rule: datel 
Context: date - 
Phrase: <date> 



1304a 



1304 



1330 



1305a 



Rule: menul 
Context: — 
Phrase: <menuName> 



1305 



RuleSet 
Context: date 



1310a 



Rule: datel 
Context: date 
Phrase: <date> 



1304 



Rule: date2 
Context: date 

Phrase: from <date> to <date> 

1301 



RuleSet I320a 
Context: MeetingMinder^-^ 



Rule: mtg1 

Context: MeetingMinder 
Phrase: "new meeting" 



1302 



RuleSet 
Context: 



1330a 



Rule: btnl 
Context: 

Phrase: <buttonName> 



1303 



Rule: menul 
Context: 

Phrase: <menuName> 



1305 



FIG. 13 



+ 



+ 



RuleSet 
Context: date 



Rule: date1 
Context: date 
Phrase: <date> 



1304 



Rule: date2 
Context: date 

Phrase: from <date> to <date> 

1301 



Current Context: Current Context: Current Context: 
"Finder" "MeetingMinder" "MeetingMlnder 

Date 



Not Active 



Not Active 



Active 



1310 



RuleSet 

Context: MeetingMinder 



Rule: mtgl 

Context: MeetingMinder 
Phrase: "new meeting" 



1302 



Not Active 



Active 



Active 



1320 



RuleSet 
Context: 



Rule: btn1 
Context: 

Phrase: <buttonName> 



1303 



Rule: menul 
Context: 

Phrase: <menuName> 



1305 



Active 



Active 



Active 



1330 



FIG. 14 



+ 



Scan Rule 
Sets 



Wait for Speech 
1501 



I 




I 



Update Current Context 
1505 



1500 




Get Language Model Y 
from this Rule Set 
1511 



I 



Include Language Model 
YinX 
1513 



Enable Recognizer with Language 
Model X 
1517 



FIG. 15 



^1600 



Wait for Words from Recognizer 
1601 



Return Words from Recognizer 
1603 

\ 

Match Recognized Words and 
Create Variable Bindings with 
Speech Rules 
1605 




Return to Idle State 
1611 





Yes 




r 


Perform Script with Variable 
Bindings 
1609 







FIG. 16 



